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Dynamic Range Compression Method 


FIELD OF THE INVENTION 
5 The present invention relates to methods and apparatus for controlling 

pixels in image sensors generally and per pixel manipulation In particular. 

BACKGROUND OF THE INVENTION 

Figure 1 depicts a prior art charge integration pixel 10 located at the i-th 
row and a j-th column of a vision sensor (not shown). Pixel 10 comprises a 
10 photodetector represented by current source lph(i,j); a switch . 12, a capacitor 14 
and a readout circuit 16. Switch 12 may be any type of sample and hold a 
device such as a semiconductor. Capacitor 14 functions as a storage device or, 
spec'rficaily, as an integration capacitor. 

Pixel 10 generates photocurrent lph(i,j), which is generally proportional to 
15 the intensity of the light impinging on the photodetector. When closed, switch 
12 conducts photocurrent iphOJ) and charges the capacitor 14. In some 
embodiments, prior to charge integration, capacitor 14 is completely discharged. 
In this instance, initial voltage VinMai across the capacitor 14 is 0 and rises 
linearly with the accumulation of charge. 

20 _ If photocun-ent lph(i,j) is time invariant during charge integration, and if 
switch 12 is shut for an exposure time t = teCj), then an accumulated charge 
may be calculated as per equation (1). 

* (1)Q^(i.j) = lph(ij)-tE(i.j) 

The accumulated voltage V^(i J) across capacitor 14 is: 

25 (2) V\i,j)= '"^'■'^ ^^'■'^ 

where Ci is the capacitance of capacitor 14, 

Proof for the following is described In full in the attached Appendix. 
Herein are some of the equations necessary for understanding the present 
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invention. For ease of understanding, tlie equation numbers in the specification 
correspond to those in the Appendix. 

The ratio between the saturation voltage and the cutoff voltage »s 
defined in equation (5) as the electrical signal dynamic range DR®. 

5 (5) DR' = ^ 

y CO 

From the Appendix it can be seen that for conventional sensors with 
global exposure time setting, the captured image dynamic range DR^ can be 
defined as in equation (12), 

(12) DR^=^ 

^co 

10 For prior art image sensors with globally set exposure time, the captured 

image dynamic range DR*" is equal to the electric signal dynamic range DR^ and 
is exposure time invariant 

Some image sensors have individually per-pixel-controlled electronic 
shutters, such as those described in U.S. patent applications 09/426,452 "image 
15 Sensor's Unit Cell with Individually Controllable Electronic Shutter Circuit' and 
09/516,168 "image Sensor Architecture for Per-Pixel Charge integration 
Control". For those image sensors, the captured image dynamic range can be 
shown by equation (17): 

(17) DR"- ^DR^^DR^ 

20 awhere the shutter or exposure time dynamic range DR^ is the ratio of the 

maximum to the minimum exposure time T^, 

y.iiiax 

(18) DR''=-^ 

One result from (12) and (17) is that for image sensors with 
per-pixel-controlled electronic shutters, the captured scene dynamic range DR^ 
25 may be at most an electrical signal dynamic range DR^ times better than the 
prior art image sensor's dynamic range. For instance, if the electric signal 
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dynamic range DR^ is 1,000 : 1, and the exposure time setup is in the same, 
then the captured scene dynamic range DR*" can be 1,000,000 : 1 ,or about 
120db. Thus there is still an incentive to improve the electrical signal .dynamic 
range, since it directly affects the results for image sensors with 
5 per-pixel-controlled electronic shutters. 

In image sensors with per-pixel exposure time control, since the dynamic 
range is time dependant and can be significantiy improved by efficient 
management of the exposure time te, there is a need to develop a method and 
apparatus for definition of a generally optimal exposure time per cell, or pixel. 

10 

SUMMARY 

There is therefore provided, in accordance with an embodiment of the 
present invention, a method for compressing the dynamic range of an image 
15 sensor including a multiplicity of pbcels. The method includes the steps of 
exposing each of the pixels to light and producing an associated photocurrent 
per pixel, representative of the light exposure. Then, on a per-pixel basis, 
controlling exposure time of each the pixels on the basis of a monotonically 
rising convex function of the associated photocurrent of each the pixel. 

20 - The method may further include calculating the exposure time of each 
tiie pixel on the basis of the monotonically rising convex function and/or 
calculating the exposure time of each the pixel on the basis of the associated 
photoourrent. The method may also include calculating a first derivative of the 
rnonotonically rising convex function based upon a desired sensitivity of the 

25 exposure time of each the pixel. 

The step of controlling may include storing the calculated exposure times 
per pixel, accessing the stored exposure times from the memory, and 
programming the pixels according to the accessed exposure times. 
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The method may ftjrthier include accumulating charge generally linearly 
representative of the photocurrent and calculating the photocurrent as a product 
of the accumulated charge. 

There is therefore provided, in accordance with an embodiment of the 
5 present invention, an exposure controller for use in an image sensor including a 
multiplicity of pixels. The controller may include a memory, a per-pixel 
parameter and a processor. The memory may store calculates exposure time 
values. The per-pixel parameter table may contain local parameters of the 
pixels. The processor may combine, based on a set of convergence criteria, the 
10 stored exposure time values and the parameters in order to determine, on a 
per-pixel basis, an exposure time of the pixels. 

The set of convergence criteria may be based on a set of algorithms 
capable of deriving an appropriate exposure time for every pixel based on the 
monotonlcally rising convex function. The set of algorithms may be capable of 
1 5 deriving a fine tuned exposure time of the pixels. 

The exposure controller may be a chip-set external to the image sensor, 
or alternatively, at least partially integrated on the same substrate as the image 
sensor. 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated more fully 
from the following detailed description taken in conjunction with the drawings, in 
which: 

Fig. 1 depicts a prior-art charge integration pixel located at the i-th row 
25 and a j-th column of a vision sensor; 

Fig. 2 is a graphic illustration (prior-art) voltage V*" as a function of Iph and 
exposure time Te; 

Fig. 3 depicts the dynamic range compression function = f(lph) ; 
Figs. 4A/B details one embodiment of an initial setup algorithm; 
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Fig. 5 details one embodiment of a fine tune algorithm to be used in 
conjunction wfth the algorithm of Fig. 4; 

Rg. 6 is a block diagram representing the present invention as 
constructed and operated on an image sensor that facilitates individually 
5 controlled pixels. 


DETAILED DESCRIPTION 

The present invention is a method for controlling dynamic range 
10 compression via usage of a monotonically rising convex function. The present 
specification outlines a set of methods, analytical and tabular functions, and 
algorithms for capturing Images. The methods and algorithms described herein 
may be used in conjunction with the image sensors described in U.S. patent 
applications 09/426,452 "Image Sensor's Unit Cell v\rith Individually Controllable 
15 Electronic Shutter Circuif and 09/516,168 "Image Sensor Architecture for 
Per-Pixel Charge Integration Control", or with other image sensors capable of 
per-pixel electronic shutter control. The present invention may be applied to 
generally dynamic range compression. 

In one embodiment of the present invention each pbcel's exposure is 
20 controlled on the basis of its photocurrent, and is done in a way that allows 
implementation of a desirable dynamic range compression ujnction. 

Another embodiment of the present Invention is a per-pixel exposure 
control hardware/firmware/software apparatus and an exposure time processor 
usable to derive the per-pixel electronic shutter value, 

25 The present invention defines a class of dynamic range compression 

functions selectable from a generally infinite set of functions The class of 
functions exclusively used for compression is mathematically defined as 
monotonically rising convex functions, or functions which fulfill the following 
conditions: for lphi > Iph2t f(lphi) > f(lph2), and f (Iphi) < f (Iphz), where f is the first 
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derivative of the function f by its aigument Iph . Thus the derivative function is a 
monotonically falling function. 

Out of an infinite range of possibilities, only the logarithmic function of the 
kind f(lph) = ci C2*logio (Iph) is known to be used In prior art image sensors. 
5 This function is implemented in logarithmic sensors; thus the sensors are 
capable of a logarithmic response but are incapable of Individual per-pixel 
electronic shutter control. 

Fig. 3 depicts three different functions for varying exposure 4imes t^, 
including a representation of a dynamic range compression function V° = f(lph) 
10 useful in the shaping of the response in a pixel or unit cell. Typically, the 
function may be a monotonically rising convex ftinction of Iph- 

A linear representation 30 illustrates the accumulated voltage when 
exposure time te = tE^^^. A linear representation 34 illustrates the accumulated 
voltage when the exposure time te = te^^. Finally, a linear representation 32 
15 illustrates the accumulated voltage V*^ accorcling to the monotonically rising 
convex function. For representation 3?, when photocurrent lphi > Iph2 is in the 
cutoff photocurrent Iph^ to saturation photocurrent Iph^^ range: 

(23) f(lphi) > f(lph2) , and 

20 The monotonically rising characteristics of the Hinction ensure that 

original scene features are presen/ed. 

The monotonically falling characteristics of the first derivative result in 
larger accumulated voltage V*^ Increments for photocurrents Iph closer to the 
cutoff photocurrent Iph^^, which equates to weaker light intensity signals. 
25 Conversely, the voltage increments are smaller for photocurrents Iph closer to 
saturation photocurrent Iph , which equates to stronger signals. This results in 
generating greater signal swings for the weaker signals around ihe level of 
cutoff photocurrentlph^^ and smaller swings for the stronger signals around the 


saturation photocurrent Iph 


Sat 
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The first derivative of the function thus produces a change in the 
accumulated voltage V*^ as a result of a change in photocurrent Iph. and may be 
defined as a sensitivity function S(lph), where. 

(25) sil^) = ^^ 

5 For some applications rt is desirable that the sensitivity bahigh at or close 

to the cutoff photocurrent Iph^*^- This is advantageous even alio\Aflng for the 
tradeoff of less sensitivity closer to the saturation photocurrent Iph®^ where 
stronger light-intensity svwngs are anticipated. 

Please note that although the sensitivity itself is compression function 
10 dependant, the maximum captured scene dynamic range DR*" is not, as has 
been demonstrated in formulas (17) and (18). 

Another feature of the monotonically rising convex ftjnction is that therie is 
a one-to-one correspondence between the accumulated voltage function 
values and the photocurrent Iph function. The monotonically rising convex 
15 function is inverse only in the range between cutoff and saturation photocurrente 
Iph^^and Iph^^*. This means that there exists a function f'' for which, 

(26) Iph = f "'(V^), in the range [V^co, V^satl 

It is important to note that this feature enables the calculation of 
photocurrent Iph on the basis of a measurable voltage V*^ (Fig. 1). This in-tum 
20 allows for determining the exposure time tg for every pixel, to be described 
hereinbelow. 

The dynamic range compression ftinction can be selected to meet the 
required performance or the observer's taste. Included within the scope of this 
invention are other applicable functions that are of the monotonically rising, 
25 convex type, which can be presented either in an analytical or in a tabular form. 
While prior art has emphasized the usage of logarithmic functions, it is asserted 
that alternative functions, such as the monotonically rising convex function, are 
applicable. 
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Logarithmic function, such as that followed by the human eye's retina 
response, is well-known and widely used. For the logarithmic function, which 
spans the entire dynamic range, it can be demonstrated that, 


(27) FVp.) = /(/p.) = 


'10 jCO ^ ^co ^"&I0 J 


ph) J ^r-phJ jSa 


log 


10 jCO 


and. 


Sat ^CO 


1 


(28) 5(7^,) = 

log,o^-lo&o7& 

-^ph 

Thus, for ia logarithmic dynamic range compression function, the 
sensitivity S is inversely proportional to photocurrent Iph or inversely proportional 
to the light intensity. 

10 One method for shaping the dynamic range to meet the required 

compression function is described now. The present invention describes a 
method and apparatus for setting the exposure time te for each pixel to 
accomplish a high dynamic range which complies with the selected dynamic 
range compression function on one hand and with the captured scene on the 

15 other. 

The exposure time setup may be divided into two parts, an initial setup 
and fipre tuning, illustrated In Figs, 4A/B and 5 respectively. 

Reference is now made to Figs. 4A/B. a block diagram illustrating an 
initial setup process 40 Process 40 comprises three phases: a charge 
20 integration phase (steps 42 - 56), an identification of always-off pixels phase 
(steps 58 - 80) and an identification of always-on pixels phase (steps 82 - 102). 

Charge integration phase: Process 40 commences (step 42) with 
selection of the pixel at location (i = 0, j = 0) (step 44)- The time exposure tE of 
the pixel at (i = 0, j = 0) is set to te^''^ (step 46). Via steps 48 - 54, process 40 
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Increments from pixel to pixel along both the V and the H axis, setting the time 
exposure tg of each pixel to ts^^^ - The loop of steps 46-54 is completed when 
the time exposure te of the last pixel at the location (i=H-1, j = V-1) (steps 48 
and 54, respectively) is set to tE^*^. In step 56 an image is captured and there is 
5 charge integration of all the pixels. 

It is noted that similariy, process 40 could commence wijh initializing ail 
the pixels to tE^"^ rather than to te""*" • r 

identification of the ''Always off' Pixels (ahvays saturated). This 
phase commences with selection of tfie pixel at location (i = 0, j = 0) (step 58). 
10 In step 60, the voltage of the pixel is read. If the voltage Vc accumulated 
(during the exposure time ts^^) is greater than the saturation value V^sat (step 
62), their exposure setup is left unchanged at te"^". 

It is noted that the assumption is that the voltage V^(ij) over the 
integration capacitor Is directly measurable. Alternatively, even without this 
15 assumption, an output voltage Vout(ij) - video output signal may represent the 
V*^(iJ). There are also Vout values that con-espond to V^co. and V*^sat- 

For pixels whose voltage V^(i j) is in the linear range, e.g. V^co ^ V^(i,j) ^ 
V^sat, (step 64) the photocurrent Iph is calculated (step 66), and the exposure 
time tE is adjusted (step 68) to match the dynamic range compression function 
20 fGph). Pixels that fall below the cutoff (step 64) are assigned maximal exposure 
time tE^"^ (step 70). 

Via steps 72 — 78, the process 40 increments from pbcel to pixel along 
both tiro V and the H axis, repeating steps 60 - 70, as appropriate, until the last 
pixel at the location (i =H-1, j = V-1) (steps 72 and 78. respectively) are assigned 
25 an exposure time. In step 80 an image is captured and there is charge 
integration of all the pixels. 

identification of the "Always On" Pixels. This phase commences with 
selection of the pixel at location (i = 0. j = 0) (step 82). Only pixels that were at 
cutoff in the previous cycle are checked, e.g. those pixels whose exposure time 
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Is set to in step 70. In an aftemative embodinient, ail the pixels may be 
rechecked. 

In step 84, the voltage of the pixel is read. If the measured- V^(i j) is 
below the cutoff { V^Oj) < V^co) (step 88), the exposure time is left at maximum, 
5 i.e. te"^. If the measured value is in the linear range (step 88), the 
photocurrent Ipj, is calculated (step 90) and voltage V*^(i j) is adjusted (step 92) to 
match the dynamic range compression function f(lph). r 

Via steps 94 - 100, process 40 increments from pixel to pixel along both 
the V and the H axis, repeating steps 84 - 92, as appropriate until the Is^ pixel 
10 at the location (i =H-1, j = V-1) (steps 94 and iOO, respectively) are asst;^. led an 
exposure time. Process 40 ends at step 1 02. 

Reference is now made to Fig. 5, a block diagram illustrating a fine tuning 
process 110, During process 110 corrections are made to those pixels that fall 
within the linear operation range. The corrections are performed cyclically for all 
1 5 the pixels, such that the match-up to the dynamic range compression function is 
improved. The corrections may be aborted if a desirable convergence is 
accomplished or based upon other criteria or considerations. 

In theory, an image sensor behaves lineariy and the integration 
capacitor's voltage rises linearly with time for a constant photocurrent Iph 
20 between the cutolT and saturation photocurrent Iph^ and Iph^^^ respectively. In 
this case, the photocurrent Iph derived during the initial setup process 40 may be 
generally precise. Also, the exposure time te derived to match the desired 
dynamic range compression function is generally accurate. 

In practice, the linearity assumption may be correct to the first order 
25 approximation. Also, the integration capacitor value Ci may vary somewhat with 
voltage and with pixel location. 

The method described in Fig. 5 Is adapted to account for inaccuracies 
and to finely tune the exposure time te to compensate for non-linearity and for 
skews. The method is based on the accurate tracking by the voltage of the 
30 dynamic range compression function. 
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The method conrecte the exposure time t^ values until the disparity 
between the measured integration capacitor's voltage and the dynamic range 
compression function value reaches a desirable accuracy. 

It is noted that when the f(lph) function value is equal to the measured 
5 voltage V(i j), the cunrent exposure time tp(l j) and the new calculated exposure 
time te"®^ are the same. The method also takes into account -that during the 
process of tuning the exposure time tgCIJ), tlie accumulated voftage \r(ij) may 
exceed the "linear" range and corrects the exposure time U accordingly. 

Process 110 starts (step 112) with the assumption that the exposure time 
10 for each pixel has been initially set as described in process 40. Then, an Image 
capture takes place, e.g. charge integration (step 1 14). In step 116 the process 
commences with the pixels at location (i = 0, j = 0) and the voltage is read 
(step 118). If the V^(i,j) falls into the linear range (step 120), an exposure time tg 
correction takes place (steps 122 - 124); First, photocun-ent Ipj, is calculated on 
15 the basis of the measured V^(ij) and the integration capacitor capacitance Ci 
(step 122). A new exposure time te"®" is then calculated to adjust for the 
measured integration capacitor voltage V*' (step 124). 

The new exposure time te"^ is checked to see if it falls in the exposure 
time range of [te^", te"^] (step 126). If the newly calculated exposure time is 

20 below the minimum (step 128), it is set to tE"*" (step 130). If it is above the 
maximum, it is set to te""^ (step 131). If the exposure time te"^* is in the 
exposure time range of Pe"^, te"^], and if the difference between the exposure 
time te"^* and the current value te is greater than ete (step 134), the cunrent 
exposure time te value is replaced with the newly calculated value tg . etg is 

25 an empirically set programmable value. 

After the entire an-ay is scanned (steps 1 38 - 142 are used for 
incrementation of the pixels, and steps 118 to 138 are repeated for all pixels), a 
decision is made (step 142) whether to continue or discontinue (step 144) the 
fine-tune process. This decision may be based upon reaching a desirable 
30 convergence criteria, in average, or in the worst case. Also, the decision may 
be based upon the observer's subjective impression. 
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The exposure time fine-tuning method 110 is one representation of 
many potential variations, all of which are encompassed by the principles of the 
present invention. Alternatives or variations to the present invention are as 
follows: 

Per-pixel parametric tables: The capacitance ci, saturation voitage 
V*^sai, cutoff voltage V*^co. and other parameters which might vary with the pixel 
location, may be detemiined on a per-pixel basis and-"^ stored in the 
image-sensor's pixel-associated memory tables (not shown). The methods 
described here above and similar methods may be modified accordingly. 

The photocurrent Iph and the exposure time te may be calculated using 
local parameters rather than global constants. TTiat is, capacitance Ci. 
saturation voltage V^sat, cutoff voltage V^'co may be replaced by C|(i j), Vc^(jJ). 
and V^co0.j) respectively. This may result in a fester convergence. 

Accounting for noise: Due to noise, the exposure time te may 
fluctuate. In order to reduce noise dependant fluctuations, the evaluation of the 
new exposure time te"®^ may be modified as follows: 


(29) ^r= 5J77r-T^*^raj) 

where N(i,j) Is the number of image acquisition iterations per pixel in 
the (i,j) location, for which the integration capacitor's voltage V is in the linear 
region. 

Convergence Criteria: Convergence criteria based upon the standard 
deviation may be used: 

{imj)-r)*iot^ii,jyi^+\tT'iiJ)-tE{iJ)f)^ 

(30) atr {ij) = ■ —U7-7^ 

where atE(ij), is the standard deviation in tE(i,j) after the N-1 th 
iteration, and atE"®*(i,j) is the new standard deviation calculated after the 


12 


AVO 02/03675 PCT/ILO 1/006 12 

current iteration. Further exposure time iterations can be stopped, if the worst 
case otE(i.D for any i, and j is below a certain otE value. That is, 

(31) OtE(ij)< CJte, foranyO<i<H-1.andany 0<j<V-1 

Alternatively, the average exposure time deviation being below a 
5 certain a te value can serve as the fine-tune termination criteria, tiiat is, 

(32) -^<at. 

The two convergence criteria may be combined. Also, the 
convergence criteria may be combined with the observer's subjective 
judgement as to when the result accomplished is satisfactory. 

10 Reference is now made to Fig. 6, a block diagram of a pixel electronic 

shutter control system 200 and associated image sensor, based on the 
considerations and the methods presented in Figs. 4 and 5. System 200 
facilitates individually controlling each pixel. 

System 200 may comprise an image sensor 202, an analog-to-digrtal 
15 (A-to-D) converter 204, an exposure controller 206, an exposure memory 
array 208 and an optional pbcel parameter memory array 209. 

A-to-D converter 204 may comprise an analog Input that is 
connectable to video output of image sensor 202 for receipt of an analog 
video Vout- Converter 204 samples video output Vout inrsync with the video 
20 pixel-outgoing rate, and converts the analog video Vout into digital video DVout. 
Th^ digital video DVout may be output from converter 204 on the n-bit DVout. 
where n may be equal to or greater than q, the number of bits of the 
digitally-stored exposure time teO j) values. 

The exposure controller 206 receives digital video DVout from the 
25 converter 204 and calculates the new set of exposure time values tgOj). An 
exposure controller program 214 may be stored in an internal or external 
program memory 210, 
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Controller 206 may calculate the photocurrent Iph on the basis of the 
digital video DVom- Digital video DVout corresponds to voltage V^, which 
in-turn corresponds to the integrated charge Qa stored in the capacitor. 

Controller 206 may also calculate the initial and the finely-tuned 
5 exposure time value tE(i,j) to match the selected dynamic range compression 
function f(iph), for each pixel individually. These calculations may be based 
on processes 40 and 110- Altematively, the dynamic rafige compression 
function f(lph) may be selected from a dynamic range compression function 
menu, such as a parameter table 212. 

10 Controller 206 may then store the calculated q-bits wide tE(i j) values in 

' exposure time memory 208. The storage may be done at pixel video rate. 

Memory 208 may then load the new exposure time into the image 
sensor 202. Controller 206 may control the loading. 

The loading may be performed after the completion of the 
15 next-to-be-used exposure time values calculation and their storage in the 
exposure memory 208. Alternatively, the tE(i j) calculations, their storage in 
the memory 208, and their loading to image sensor 202 may be performed 
concurrently. This is especially useful for real-time video image sensors that 
have to keep up with the video frame rate. 

20 - Controller 206 may decide whether to continue image acquisitions and 

subsequent exposure time caicuiation iterations or to stop. 

Memory 208 may be an H X V memory array, which stores the q-bit 
tE(liD values. 

The array may be addressed using the column, the row - and - i, j 
25 indexes. During the charge integration process, the image sensors may be 
programmed by loading, In one batch for the entire image sensor array, the 
k-th exposure time bit which is then subject to integration of length T*. It is 
noted that the integration time can be of any length. 

Concurrently with the integration for the k-th bit, the image sensor is 
30 programmed for the i-th bit integration. After the integration, that corresponds 
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to the k-th bit is completed, tiie integration for tlie i-th bit can start It is noted 
that the programming/integration of all the q bit-planes can be done In any 
sequence, and the plane bits may be loaded line after line, p bits at a time. 

It is noted that each of the functions described can be integrated on 
5 the same die with the image sensor or be a part of a separate chip. 

The per-pixel exposure time processor may be impjemented either 
extemally to the image sensor in a fomi of a chip-set, or to be partially, or 
fully integrated on the same substrate with the pixel. 

The algorithm for the calculation on the new exposure value tE"°'"CiJ) 
10 may be based on a per pbcel parameter table fomnulated in equation (29) . It 
is noted that additional memory array may be required to store the N(i,j) 
values^ 

The algorithm for the calculation of the standard deviation in exposure 
time a IeO,]) fomiulated In equation (30) also requires an array storage for 
15 N(i,j). 

An image sensor with per-pixel electronic shutter control enables 
individual control of each pixel's exposure time and thus allows implementation 
not only of dynamic range compression but many other useful effects as well. 
Thus, an image sensor along with the apparatus described herein, may select a 

20 variety of functions given in an analytical or a tabular fomi that can be used.to 
achieve a variety of effects. 

!t will be appreciated by persons skilled in the art that the present 
inventibn is not limited to what has been particulariy shown and described 
hereinabove. Rather the scope of the present invention is defined by the claims 

25 that follow: 
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APPENDIX 

Accumulated voltage A/^(i j) complies with equation (2) in the region 
between a lower cutoff voltage A/^co and an upper saturation voltage V^sat. 

Cutoff voltage V^co is typically the lowest possible voltage, in absolute 
5 potential value, that can be separated from noise. Below the cutoff value, the 
signals are too small to represent meaningful information and are considered to 
be in the cutoff region. Saturation voltage \/^sat is the highest possible voltage, 
in absolute potential value, that does not result in signal clipping. 


10 due to the die, location, and process dependant skews of each individual image 
sensor, for the present analysis, it will be assumed that voltages V^sa, and V^co 
are constant in their value. 

Based upon equation (2) and for a specific exposure time te, the 
saturation photocurrent Iph^^kij) and the cutoff photocurrent lph^^(i,i) that cause 
1 5 saturation and cutoff, respectively, are: 


The values of saturation photocurrent Iph (i j) and cutoff photocurrent 
Iph^^(ij) define, for a specific exposure time tE. the photocurrent Iph boundaries 
20 that define the image sensor's region of operation, and also the electronic 
limitations of the sensing circuit. It is noted that each image sensor may have 
different boundary values, resulting from variables such as quality of the optics, 
degree of quantum efficiency, choice of processes used to manufacture the 
sensor, and differing circuit designs. 

25 The ratio between the saturation photocurrent lph^^*(ij) and cutoff 

photocurrent Iph^^OJ) is defined in equation 5 as the electrical signal dynamic 
range DR^. 


Although saturation voltage V^sai and cutoff voltage V^co may vary slightly 


(3) 



(4) 
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(5) DR'^-^ 

A typical image sensor's electric signal dynamic range DR® is in the order 
of 1000 : 1. . The dynamic range DR® is sometimes described in decibels, 
which is. 


5 (6) DR%, = 20 . log,o 

For a typical image sensor, and in decibels, the electrical signal dynamic 
range DR^ is about 60 dB. 

It is noted that the electric signal dynamic range DR® is not a captured 
image dynamic range DR^ although the two values may be the same for the 
10 some common types of image sensors. The captured Image dynamic range 
DR^ is defined as, 


(7) DR'^^ . ..CO 


^ max[/gr0.7)] 
miii[/5f(7,j)] 


where DR^ is the light-intensity dynamic range or the ratio between the 
maximum saturation photocurrent lph^*Oj) and minimum cutoff photocurrent 
is Iph^^OJ), for any (i,j) in the 0 < i < V-1 and 0 < j < H-1 range. 

For prior art image sensors, all pixels are exposed for the same exposure 
time tE. Exposure time te may vary in the range ts""" to te^^ where, 

tE^^ is the image sensor's minimal exposure time, and 

Ie^^ is the image sensor's maximal exposure time. 

20 It is noted that for the prior art image sensor the exposure time te may 

vary, however all pixels vary together and their charge integration is identical. 

For the purpose of analysis let us assume that the stared-at[??] scene is 
of extremely wide dynamic range (infinite), and is limited only by the image 
sensor's capabilities. For the prior art image sensors where the exposure time 
25 is set to te*"'". the corresponding saturation and cutoff photocurrent values Ipn^^' 


and lph^° are: 
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(8) T = Ls^lllL 


(9) 


For this particular situation the captured scene dynamic range DR 
derived from (8) and (9) is, 

5 (10) DR =^ 

Similarly, for the maximum exposure it can be derived that the dynamic 
range is, 

(11) DR^=-^ 

and for any exposure time te set between the minimum and the 
10 maximum, for prior art image sensors, the captured image dynamic range DR 
is, 

(12) DR^ 

\ / pre 

^CO 

and thus, with globally set exposure time te. the captured Image dynamic 
range DR^ is equal to the electric signal dynamic range DR^ and is exposure 
1 5 time invariant. 

Reference is now made to Fig. 2 a graphic demonstration of equation 12. 
Fig. 12 depicts the accumulated voltage as a function of photocun"ent Iph, and 
exposure time te for three different voltages . A linear representation 20 
illustrates the accumulated voltage when exposure time te = Ie*^*^. A linear 
20 representation 22 illustrates the accumulated voltage when exposure time 
^^MiN < t£ < Ie^. a linear representation 24 illustrates the accumulated voltage 
when the exposure time ta = ts^^ 
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The basic observation is that although the function of the accumulated 
voltage V varies as a function of the exposure time te, the function slope is 
invariant, and so is the captured scene dynamic range. 

In image sensors per-pixel electronic shutters the exposure time tg of 
5 each pixel can be individually set within a range of exposure times from tn""" to 
tg"^ such that when photocurrent lphi(ij) > IphzOJ), the exposure time teaCiJ) < 
tEi (i,j) and the accumulated voltage V2 > V*^i • 

Based on these assumptions, the image sensor's maximum saturation 
photocurrent is: 

10 (13) ijri, -— 

* 1 


tnnn 

•E 


and the minimum cutoff photocunrent /^f is; 


(14) - 


^co 


—ph .max 


Therefore, for image sensors with per-pixel electronic shutters, the 
captured scene dynamic range DR^ when the shutter Is set according to (13) 
15 and (14) is: 


—Sat 

(15) DR'^^ or. 

±ph 

•pre ^taox 

(16) DR'^-^*-^ or, 

^CO ^E 

(17) DR^ - DR^ • DR'^ , where 

(18) DR'^-^ 


20 Therefore, for image sensors with individually per-pixel-controlled 

electronic shutters, the shutter or exposure time dynamic range DR^ is the ratio 
of the maximum to the minimum exposure time ts. The electronic shutter values 
may be set within the exposure time range. 
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The maximum exposure time dynamic range DR is a quality indicator for 
this type of an image sensor. It determines, along with the electrical signal 
dynamic range DR^ , the captured scene dynamic range DR^ 

For image sensors that support real-time video, DR^ of 1,000 : 1 is 
5 feasible. For still video image sensors of this type. DR^ is theoretically limitless, 
as there are no constraints on the total programming of the exposure time. 
However, there is a practical useful limit to DR^. 

Assuming that DR^ > DR^ and that the available electric signal is utilized 
to the maximum, for te""'", V = Vco. and for. tEmax, V*" = V^'sat. This set-up 
10 provides complete utilization of the entire linear region. As such. DR^ = DR^. 
For tE < ts""*", and for te 3 tEmax. ^ V^sat, the Vc range must be set in such a 
way that. 3 V^co. and V*^ < V^sat . Otherwise, the output signal infringes the 
saturation or/and cut-off regions, respectively. Therefore, 

(19) DR^ < DR^ and therefore (20) DR^<(DR^)^ 

15 One result of (19) and (20) is that for image sensors with 

per-pbcel-controlled electronic shutters, the captured scene dynamic range DR*- 
may be at most an electrical signal dynamic range DR^ times better than the 
prior art image sensors' dynamic range. For instance, rf the electric signal 
dynamic range DR® is 1,000 : 1, and the exf5osure time setup is in the same, 

20 then the captured scene dynamic range DR^ can be 1,000,000 : 1 ,or about 
120db. Thus there is still an incentive to improve the electrical signal dynamic 
range, since it directly affects the ■ results for image sensors with 
per-pixel-controlled electronic shutters. 

Dynamic range may also be expressed in decibels: 
25 (21) DR^^^DR^^DRl 

For image sensors with per-pixel exposure time control, the following is 

true: 

(22) DR*-db ^ 2XDR®db 

20 
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CLAIMS 

1. A method for compressing the dynamic range of an image sensor 
comprising a multiplicity of pixels, the method comprising the steps of: 
5 exposing each of said pixels to light and producing an associated 

photocun-ent per pixel, representative of said light exposure; and 

on a per-pixel basis, controlling exposure time of each said pixels on the 

basis of a monotonically rising convex function of said associated 

photocurrent of each said pixel. 

10 2. The method according to daim 1, and further comprising the step of 

calculating said exposure time of each said pixel on the basis of said 
monotonically rising convex function. 

3. The method according to claim 1, and further comprising the step of 

calculating said exposure time of each said pixel on the basis of said 
1 5 associated photocurrent. 

4. The method according to claim 2, and wherein said step of controlling 
comprises the steps of: 

storing said calculated exposure times per pixel; 
accessing said stored exposure times from said memory ; and 
20 programming said pixels according to said accessed exposure times. 

5. The method according to claim 1, further comprising calculating a first 
derivative of said monotonically rising convex function based upon a 
desired sensitivity of said exposure time of each said pb«el. . 

6. The method according to claim 1 , further comprising; 

25 accumulating charge generally linearly representative of said 

photocurrent; and 

calculating said photocurrent as a product of said accumulated charge. 

7. An exposure controller for use in an image sensor comprising a 
multiplicity of pbcels, the controller comprising: 
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a memory for storing calculated exposure time values; 

a per-pixel parameter table containing local parameters of said pixels; 

and 

a processor for combining based on a set of convergence criteria, said 
5 stored exposure time values and said parameters in order to determine, on a 
per-pixel basis, an exposure time of said pixels. 

8. The e^qDosure controller of claim 7, wherein said set of convergence 
criteria is based on a set of algorithms capable of deriving an appropriate 

" exposure time for every pixel based on said monotonically rising convex 
10 function. 

9. The exposure controller of claim 8, wherein said set of algorithms is 
capable of deriving a fine tuned exposure time of said pixels. 

10. The exposure controller of claim 7, wherein said exposure controller is a 
chip-set external to said image sensor. 

15 11. The exposure controller of claim 7, wherein said exposure controller is at 

least partially integrated on the same substrate as said image sensor. 
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